Fast Simulation for Computational Sustainability Sequential Decision Making Problems
نویسندگان
چکیده
Solving sequential decision making problems in computational sustainability often requires simulators of ecology, weather, fire, or other complex phenomena. The extreme computational expense of these simulators stymie optimization and interactive visualization of decision rules (policies). This work presents our results in creating an interactive visualization for a wildfire management problem whose simulator normally takes several hours to run. We successfully generate visualizations for a landscape’s development over 100 year time spans within 17 seconds, when the original simulator took several hours.
منابع مشابه
Solving Sequential Decision-making Problems under Virtual Reality Simulation System
A large class of problems of sequential decision-making can be modeled as Markov or Semi-Markov Decision Problems, which can be solved by classical methods of dynamic programming. However, the computational complexity of the classical MDP algorithms, such as value iteration and policy iteration, is prohibitive and will grow intractably with the size of problems. Furthermore, they require for ea...
متن کاملSequential Decision Making in Computational Sustainability Through Adaptive Submodularity
8 AI MAGAZINE One of the central challenges in computational sustainability is how to allocate resources in order to optimize long-term objectives. An archetypal application is conservation planning: managers recommend patches of land in order to achieve long-term conservation of biodiversity. In this and similar applications, we typically have to make decisions over time: financial resources (...
متن کاملFlexible State-dependant Machine Scheduling Problems Using Reinforcement Learning
This paper presents a simulation-based optimization methodology called reinforcement learning (RL) and suggests a neural approach to approximate the values when the systems under study are complex and involve large-scale decision-making sequential tasks. Computer simulation based reinforcement learning (RL) methods of stochastic approximation have been proposed in recent years as viable alterna...
متن کاملChallenges for CPAIOR in Computational Sustainability
The notions of sustainability and sustainable development were first introduced in the seminal report of the United Nations World Commission on Environment and Development, known as the Brundtland report or Our Common Future [3]. Sustainable development is “development that meets the needs of the present without compromising the ability of future generations to meet their needs.” Sustainability...
متن کاملFast Intra Mode Decision for Depth Map coding in 3D-HEVC Standard
three dimensional- high efficiency video coding (3D-HEVC) is the expanded version of the latest video compression standard, namely high efficiency video coding (HEVC), which is used to compress 3D videos. 3D videos include texture video and depth map. Since the statistical characteristics of depth maps are different from those of texture videos, new tools have been added to the HEVC standard fo...
متن کامل